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Abstract 


Alaost  sure  convergence  of  averages  of  the  rows  is  proven  for 
arrays  of  randoa  variables  and  for  random  elements  in  Banach  spaces, 
which  can  be  extended  to  square  arrays  with  independent  and  identically 
distributed  coluans.  The  result  requires  that  each  column  converge  to  a 
linitii^  random  variable.  A  counterexample  is  given  to  show  that  the 
result  fails  without  the  condition  on  the  columns. 
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Let  '{3^j)  for  i  s  J' <  ♦  1,  i  ■  1,2,... 

of  reel-vmlued  random  variables  on  a  probability  space  (fl,B,P).  Ke 
shall  say  that  is  a  square  array  if  n^  >  •  for  all  i,  a 

triangular  array  if  n^  ■  i,  and  an  array  if  n^^  is  any  sequence 
increasing  to  infinity.  Denote  by  the  column  j» 

where  i  a  inf  (t:  j  s  n^}  is  the  first  index  for  which 
is  defined.  The  columns  are  random  variables  taking  values 

in  K  ,  the  space  of  sequences  of  real  nuitbers.  Independence  of  the 
columns  is  defined  as  usual,  but  unlike  the  usual  definition,  X  ,  and 

.j 

X^j^  Kill  be  called  identically  distributed  if  for  i  ■  inf  (l:  j  s  n^ 
and  k  s  n^),  the  random  sequences  snd 

^^1^1^,*..)  have  the  same  distribution. 

Suppose  an  array  has  independent  and  identically  distributed  columns. 
By  analogy  with  Kolmogorov's  law  for  i.i.d.  sequences,  one  night  suppose 

•  •  i  •  .1 

that  if  EXi.  ■  0  for  all  i  ai^  j  then  lim  n,^  £  X,,  •  0  almost 
^  i^  ^  j.l 

surely.  However,  this  is  not  correct,  as  example  1  below  demonstrates. 

In  Theorem  1,  we  obtain  a  strong  law  with  the  additional  condition  that 
each  colurni  (equivalently,  the  first  column)  converges  to  a  limiting 
random  variable.  This  result  is  an  extension  of  Kolmogorov's  Law  for 
i.i.d.  sequences.  The  method  yields  the  same  result  for  randan 

elements  in  a  separable  Banach  space.  This  result  is  given  in  Theorem  2, 
which  extends  Mnnrier's  (1953)  law  of  large  numbers  to  arrays. 

Example  1 :  Let  every  element  of  a  triangular  array  be  i.i.d.  obeying  a 

symmetric  stable  law  with  characteristic  function  e*  for  some 

n 

1  <  a  <  2.  TWO  properties  of  this  distribution  arc  that  £  X  ,  has 

j.l  "3 

tho  sane  distribution  as  "  ** 


** 

-  2  - 

6  2  a.  Letting  f(x)  be  the  density  of 


E  P(  ?  X  .  >  n]  »  I  P(X.  > 
n»l  5*1  n*l 

^  ^  Ql-l/a 

n  X®/^““^^f(x)  dx  -  «,  (1) 


the  next  to  last  inequality  resulting  from  an  application  of  Fubini's  the- 
oran,  and  the  final  equality  follovrs  from  the  non  existence  of  the  a/(a-l) 
moaent  coupled-  with  the  fact  that  Xjj  has  a  synmetric  distribution.  The 


-1 


n 


sequence  n  E  X  .  is  Independent  for  different  n.  so  the  Borell- 


5=1 


nj 


Cantelli  theorem  implies  that  n~^  Z  X  .  >  1  infinitely  often,  and 


j-1 


h5 


hence  it  does  not  converge  to  zero  almost  surely. 

Evidently  additional  conditions  are  necessary  to  obtain  a  strong 
law.  Theorem  1  below  shows  that  convergence  of  the  first  column  to  a 
limiting  random  variable  suffices.  We  do  not  know  if  it  is  possible  to 
further  weaken  this  condition. 


Tlteorem  1;  Let  he  an  array  of  real  variables  with  independent 

and  identically  distvibuted  columns.  Suppose  that  the  first’  column 

converges  almost  surely,  i.e.  there  exists  a  random  variable  X^  such 

that  lira  ®  Xj(w)  a.s.  If  llm  *  0  and  E(suplXj^j-Xjl)  <  •», 

i  i^^  i 

then  for  almost  all  u  c  (1, 


1  * 
lira  —  I 

n^  "i  5*1 


0 


♦  s 


Proof!  This  is  a  special  case  of  theorem  2,  and  does  not  appear  to  have 
a  simpler  proof. 

For  the  case  where  the  array  consists  of  random  elements  in  a 
separable  Banach  space,  we  have  the  following  result,  given  in  theorem  2. 


Theorem  2:  Let  be  an  array  of  random  elements  in  a  separable 

Banach  space  B.  Suppose  the  array  has  independent  and  identically  dis¬ 
tributed  columns,  and  there  exists  a  sequence  of  random  elements  su 
that  lim  ■  Xj(«)  almost  surely.  Defining  EX^j  via  the  Bochner 


!•»« 


intergral,  if  lira  EXj^j  ■  0,  and  E(s^{|X^^  -  Xj||)  <  »,  then 

i-Ko  i 


n. 


lim  11^  IX  ||.0. 
j«i  13 


almost  surely. 


Proof;  Let  (X|j)  be  a  square  array  on  a  probability  space  (O',  8,  P*), 
such  that  the  columns  are  i.i.d.  copies  of  X^^.  Define  0^(8)  to 

be  the  Banach  of  sequences  converging  to  0  in  B,  normed  in  the  obvious 
way  be  |||  •  ||| ,  defined  as 

ill(bi,b2,..0llj  ■  II  bjll  , 

where  |j  •  ||  is  the  norm  on  B.  It  is  easily  verified  that  Cq(B)  is 
separable.  Define  random  elements  in  Cq(B)  by 


Yj  -  (X*j-Xj,X*^,-X^,...) 


•  4  • 


It  is  easily  checked  that  lia  X. .  ■  X.  implies  lim  X! .  ■  X.,  and  hence 

*3  3  *3  3 

Yj  take  values  in  Cq(B),  the  space  of  sequences  convergent  to  zero. 
Clearly  are  also  i.i.d.  Also,  Eil|Yj|ii  ■  E(sup|]  X^^  -  X^||  )<  »  by 

assuqition.  Thus  Mourier's  (1953)  Law  of  Large  Mmibers  applies,  and  isq)lies 
that 

lim  mi  I  Y.  -  EYjIll  -  0, 
n**  j*l  ^ 

almost  surely.  It  is  easily  checked  that  this  implies  the  result. 

Some  concluding  comments  are  in  order.  Strong  laws  for  arrays, 

unlike  weak  laws  (see  Petrov  (1975),  for  example)  or  the  central  limit 

theoran,  appear  not  to  have  been  widely  studied.  Thus  there  do  not 

exist  any  results  for  arrays  directly  comparable  to  ours.  The  closest 

one  can  come  is  the  following  result.  Under  the  conventional  assumption 

that  rows  consist  of  independent  variables,  and  no  restriction  on  the 

columns,  the  average  of  the  rows  centered  to  have  zero  means  will 

converge  almost  surely  to  zero,  provided  that  sup  E|X..|^*®  <  for 

i,j 

some  e  >  0.  This  is  easily  proven  by  an  appeal  to  the  Borel-Cantelli 
Leana,  and  is  also  a  special  case  a  result  due  to  Taylor  (1979). 

In  terms  of  applications,  the  following  corollary  may  be  of 
interest. 

Corollary  to  Theorem  1:  Let  (X.)  be  a  sequence  of  i.i.d.  real-valued 

random  variables.  Let  R  E  be  a  sequence  of  measurable  functions 

such  that  lim  ^^(x)  ■  ^(x)  for  some  limiting  measurable  function 

for  all  X  e  R.  If  lim  E  ♦jj(Xj)  ■  0,  and  E  sup|^^(Xj)|  <  •»,  then 

n 

1  " 

n  ^  converges  to  zero  almost  surely. 

"  j-1  "  5 


-  s  • 


Finally,  we  note  that  the  probles  of  proving  strong  convergence  of 
kernel  density  estijoates  can  be  posed  as  a  question  about  convergence  in 
non  of  the  averages  of  rows  of  a  certain  array  of  random  variables. 

Taylor  (1979)  uses  this  approach  stq>pleaented  with  a  strong  law  for 
arrays  of  random  elements  in  a  Banach  space  to  obtain  strong  convergence  of 
kernel  density  estimates.  Although  the  array  of  random  elements  used  in 
this  approach  has  independent  and  indentically  distributed  columns, 

Taylor's  strong  law  uses  only  the  row- wise  independence.  It  seems 
plausible  that  use  of  the  i.i.d.  structure  of  the  array  should  permit  us 
to  obtain  a  stronger  result.  Unfortunately,  our  Theorem  2  cannot  be 
applied  since  the  columns  fail  to  .converge  to  a  limit,  in  the  case  of 
kernel  density  estimation.  Perhaps  some  variant  of  Theorem  2  can  be 
obtained  wheih  will  generate  the  desired  result. 
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2d.  ABSTRACt 


Almost  sure  convergence  of  averages  of  the  rows  is  proven  for  arrays  of  random 
I  varibales  and  for  random  elements  in  Banach  spaces,  which  can  be  extended  to-  square 

arrays  with  independent  and  identically  distributed  columns.  The  Banach  space  result 
requires  that  each  column  converge  to  a  limiting  random  variable,  while  the  real- 
valaed  random  variable  holds  under  a  weaker  condition.  A  couterexample  is  given 
to  show  that  the  result  fails  without  the  condition  on  the  colutais. 


